How Fast Elements can Affect Slow Dynamics 
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A chain of coupled chaotic elements with different time scales is studied. In contrast with the adi- 
abatic approximation, we find correlations between faster and slower elements when the differences 
in the time scales of the elements lie within a certain range. For such correlations to occur, three 
features are essential: strong correlations among the elements allowing for both synchronization and 
desynchronization, bifurcation in the dynamics of the fastest element by the change of its control 
parameter, and the cascade propagation of the bifurcation. The relevance of our results to biological 
memory is briefly discussed. 



Many biological, geophysical and physical problems in- 
clude a variety of modes with different time scales. The 
study of dynamical systems with various time scales is 
important for understanding the hierarchical organiza- 
tion of such systems by investigating the dynamic inter- 
actions among modes. Adiabatic elimination |l| is often 
adopted for systems with different time scales. If the 
correlations between modes with different scales are ne- 
glected, the fast variables are eliminated and the dynam- 
ics of the system is expressed only by the slow variables. 
The fast variables are then replaced by their averages and 
noise. In this adiabatic approximation, the characteris- 
tics of the dynamics of the fast time scales disappear, 
and the " information flow" from fast to slow time scales 
is only retained as memory terms in a Langevin equation. 

The adiabatic approximation is valid when the differ- 
ences between the time scales are large. However, when 
the differences are small, correlations between the modes 
appear, invalidating the approximation. Then, the fast 
scale dynamics can influence the dynamics of slower vari- 
ables. Here we investigate under what conditions the 
faster variables can influence the dynamics of the slower 
variables. We will show that a dynamical "information 
flow" from fast to slow dynamics is possible when a given 
condition is satisfied. For this, chaos is relevant since it 
makes possible the amplification of microscopic pertur- 
bations to a macroscopic scale. However, in order for 
the propagation of statistical properties from fast to slow 
variables to occur, it turns out that two other properties 
are required: coherence and a cascade of bifurcations. 

In the present paper, we investigate how the statistical 
(topological) properties of the slow dynamics can depend 
on those of the fast dynamics by adopting a coupled dy- 
namical system with different time scales. To be specific, 
we choose a chain of nonlinear oscillators whose typical 
time scales are distributed as a power series. The dynam- 
ics of each oscillator is assumed to differ only in its time 
scale, and thus there are only three control parameters in 
our model: one for the nonlinearity, one for the coupling 
strength among oscillators, and one for the difference in 
time scales. 

The concrete form adopted here is as follows: We 



choose the Lorenz equation as the single oscillator, 
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where X = (x, y, z) 
duced as 



The time scale differences are intro- 
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T i ^ = F(X i ), 



T t = T lT l 
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where F(X) = (f x (X), f y (X), f z (X)). The index of the 
elements is denoted as i with i = 1, 2, , , L =System size. 
Ti is the characteristic time scale for each element and r 
(< 1) is the time scale difference. Using a power series 
distribution for the characteristic time scales is analogous 
to the shell model for turbulence The total time scale 
difference is given by 
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In the present Letter, we adopt the system size L as 
a control parameter by fixing T to tai = 100 and couple 
neighboring elements diffusively as follows: 



T i ^ = F((E-r>)X i +~r>(X i 
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where we chose d y = 0, d x — d z = d = 0.49. The Runge- 
Kutta method was used with a time step size such that 
the fastest element Xi is computed with high precision. 

Representative examples for the time series of Xi(t) are 
plotted in FigfJ, with (L, t) = (2, 100) in (a) and (L, r) = 
(8, 1.93) in (b). In (a), there is no explicit correlation be- 
tween the dynamics of the fast time scale at i = 1 and the 
slow one at i = L = 2. On the other hand, there is phase 
synchronization Q at various time scales in (b). Here the 
phase relation between Xi and Xi+\ is anti-phase. The 
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co-variance, given by 



_({x i -(x i ))(x i+1 -(xi +1 ))) 



takes 



a large negative value j4j. As in the case of coupled 
phase oscillators with different frequencies^), it is nat- 
ural to expect that correlations appear when the time 
scale differences t become smaller. Due to chaotic in- 
stability, however, desynchronization destroys the phase 
relationship here. Switching between low-dimensional 
correlated motion and high-dimensional desynchronized 
motion, known as chaotic itinerancy^, |^, ||, appears at 
various time scales. 




FIG. 1: Time series of Xi(t). (L,t) = (2, 100) (a) and (8, 1.93) 
(b). (b) shows correlated motion of elements with various 
time scales. The colors correspond to the element index, r — 
41 at 1 < i < L and d = 0.49. 



Now we will show that the slowest dynamics at i = L 
can be influenced by the fastest element at i = 1. In or- 
der to do so, we have carried out the following numerical 
experiment: After the initial transients have died out, at 
a fixed but otherwise arbitrary point in the temporal evo- 
lution of the system, we change the control parameter r 
of the element i = 1. Then we examine how the dynam- 
ics at i = L is influenced by this change by measuring a 
statistical property of Xi,(t). 

Fig.|| shows the time series of Xi(t) for several values 
of r where the parameter r of element i = 1 is changed 
from 41 to 21 at time = 180000. Here T tota i = 100 and 
(L,r) = (2, 100) (a), (8, 1.93) (b), (10, 1.67) (c), (12, 1.52) 
(d). In Fig.|(b)-(c), the change in r leads to a novel 
state with a large amplitude and slow-scale synchronized 
motion. The characteristic time scale of this state is 
about 10 4 . This is much longer than the time scale of 
the slowest element i = L which is about 10 2 as can be 
inferred from Figj^(a). Hence we find that by modifying 
the fastest dynamics the dynamics of the slowest element 
undergoes a qualitative change. Such dependence of the 
slower dynamics on the control parameter r at i = 1 is 
observed only for 6 < L < 12 (see Fig.||(a) and Fig^(d)). 
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FIG. 2: Time series of Xi(t). At time = 180000, the pa- 
rameter r at i = 1 is changed from 41 to 21. Ttotai = 100. 
(L,t) = (2, 100) (a), (8, 1.93) (b), (10, 1.67) (c), (12, 1.52) (d). 
In (b)-(c), novel states with coherent large-amplitude motions 
appear, d = 0.49. 



In order to quantitatively investigate the dependence 
of the slow time scale on the fast time scale, we low-pass 
filter XL,(t) by averaging over the faster time scale, i.e., 
xi,{t) = J^ a dt'xL{t + t') and measure the root mean 
square of the variation of Xl (t) obtaining the Low-Pass 
Filtered Root Mean Square (LPF-RMS)[§. In FigJ(a) 
we plot the dependence of the LPF-RMS of xz,(t) on 
the control parameter r of the element i = 1 for various 
system sizes L. For sizes 7 < L < 11, the LPF-RMS 
shows a clear increase as r is decreased from 29. To 
demonstrate the size dependence, we have plotted the 
difference of the LPF-RMS of xx,(t) between the cases 
r = 41 and 21 for i = 1 as a function of L. As clearly 
can be seen, the dependence of the slowest element on 
a parameter of the fastest element only appears for 7 < 
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L < 11. We have also confirmed that this dependence 
remains when the system size L is increased, (i.e., by 
increasing T tota i). Hence the observed dependence is not 
due to a finite size effect. This dependence exists over 
finite intervals for the control parameters r of i = 1, the 
coupling strength d, and the time scale difference t, not 
only at a point in the parameter space as would be the 
case for a phase transition poj. 
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FIG. 3: (a) shows the dependence of the Low-Pass Filtered 
Root Mean Square (LPF-RMS) of XL(t) as a function of the 
control parameter r of the fastest element i = 1. T tota i 
1 0U. The colors indicate different sets of (r, L). Only in the 
range 7 < L < 11 the dependence of slow time scales on fast 
time scales appears, (b) shows the system size dependence of 
the dependence of the slow time scale on the fast time scale. 
The ordinate shows the difference of the LPF-RMS of XL(t) 
between the cases of r = 21 and 41 of the element i = 1. 



We also studied a possible dependence of the fast dy- 
namics on the slow dynamics by measuring the depen- 
dence of the root mean square of the high-pass filtered 
value for x\ (t), xi (t) = x\ (t) — J T ^/ 2 d1?x\ (t + 1') on the 
control parameter r at i = L. No such dependence was 
found, regardless of the values of (r, L). Summing up, for 
values of r corresponding to 7 < L < 11, the slow dynam- 
ics depends on the fast dynamics, but the fast dynamics 
does not depend on the slow dynamics. Hence there is an 
asymmetry in mutual dependence between the fast and 
slow variables. 

We now study under what condition the slower dy- 
namics depends on the faster dynamics. Based on sim- 
ulations of the present model for various parameters 
and also on simulations of the coupled Rossler equation 
with different time scales, we found the following three 
requirements pT| . 



First, a strong correlation, either by synchronization or 
by an anti-phase relationship, between nearest neighbors 
in the chain is required. When there is no such correla- 
tion, the adiabatic approximation for the faster dynamics 
is valid. For example, for large values of t, i.e., for L < 7 
in Figs.||), such coherence is not detectable. 

Second, a bifurcation in the fastest dynamics is re- 
quired when a control parameter of the fastest element is 
changed. In our coupled Lorenz equation with d = 0.49, 
the bifurcation from a fixed point to chaos occurs at 
r = r c ~ 29 which corresponds to the bifurcation of a 
single Lorenz equation at r ~ 24. The bifurcation is re- 
quired to make possible a switching to a different mode 
of dynamics. However, this second condition by itself 
is not sufficient for transferring the bifurcated dynamics 
to slower elements since the control parameters of these 
elements are not shifted. 

For this, a third condition guaranteeing a cascading 
transfer of the bifurcation from faster to slower elements 
is required. In the examples of Figs^, the control pa- 
rameter of the fastest element i — 1 is set to r = 21 
allowing for a stable fixed point, while the parameters 
for the other elements i > 1 are set to r = 41 giving 
chaotic motion. In this case, as can be seen in Figs.||(b)- 
(c), all elements display chaotic itinerancy between a 
highly chaotic state and several ordered states around 
fixed points. As was found in the study of chaotic itin- 
erancy, the switches from one ordered state to another 
occur irregularly through high-dimensional chaotic mo- 
tion. In order to distinguish ordered states from chaotic 
states, we measured the variance over a finite interval, 
Vi(t;t c (i)) = j^y f M0 dt'( Xi (t + f) - Xi (t + Ti + t')) 2 , 

where t c (i) is a constant that is scaled as t c oT l jl2|]. With 
the help of this quantity, we can roughly roughly esti- 
mate whether the element i is in an ordered state or 
not. If this variance is smaller than its long-term aver- 
age, Vi(oo) = UmT^co^ J Q T dt'{xi(t') - Xi(T t + t')) 2 , the 
element is in an ordered state. From the time series of 
this variance we found that the intervals where the chain 
is in the ordered state can be rather long when there is a 
dependence of the slower dynamics on the faster dynam- 
ics (i.e., 7 < L < 11). 

In order to check the residence time distribution of the 

< 



Vi(t;t c (i)) 
Vi (oc) 



ordered states, we have classified states with 
0.75 (l| as ordered and plotted the results for systems 
sizes L = 6, 8, 10, 12 in Fig.[|. As can be seen, the resi- 
dence time distribution follows a power low distribution 
for 7 < L < 11 where the dependence of the slower ele- 
ments on the fastest element is realized. This power law 
distribution allows for the propagation of bifurcations to 
ordered states over all elements. It is reminiscent of the 
energy cascade in fluid turbulence (as described in the 
shell mo del P) a nd the information cascade in a globally 
coupled map||14|. 

When r is small, as is shown in Fig.||(d), the chaotic 
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FIG. 4: The residence time distribution of ordered states is 
plotted for L = 6,8, 10, 12. T tota i = 100. For L = 8, 10, where 
the propagation from faster to slower elements is observed, a 
power-law distribution is observed. The dotted line with slope 
—2 is plotted for reference. 



instability is large and the sensitivity to the dynamics of 
neighboring elements is strongly disturbed by the mixing 
property. Hence the cascade of bifurcations stops at some 
element with an intermediate time scale and cannot be 
propagated to the slowest element. 

In conclusion, we have shown that a statistical prop- 
erty of a slower element can successively be influenced 
by a faster element in a system of coupled chaotic ele- 
ments with different time scales distributed in a power 
law. This propagation of information is realized when 
there is (i) a strong correlation between neighboring el- 
ements such as synchronization or anti-phase oscillation, 
(ii) a bifurcation in the dynamics of the fastest element 
as its control parameter is changed, and (iii) a cascade 
propagation of this bifurcation. The mutual dependence 
of the elements in the chain is asymmetric in the sense 
that a change of the fastest element can influence the 
slowest element, but that a change of the slowest element 
hardly ever influences the fastest element. Since the the 
three requirements were found to be valid for both the 
coupled Lorenz equation and the coupled Rossler equa- 
tion, we believe that it is reasonable to expect that the 
propagation from faster to slower elements as described 
in this letter is a universal property of systems of coupled 
chaotic dynamics with distributed time scales. 

Biological systems often incorporate dynamics at var- 
ious time scales with changes at faster time scales some- 
times influencing the dynamics of slower time scales lead- 
ing to various forms of 'memory'. A cell can e.g. adapt 
to an external condition and maintain its memory over 
a long time span through a change of its intra-cellular 
chemical dynamics. In a neural system, a fast change in 
the input is kept as a memory over a much longer time 
scale when a short-term memory is fixated to a long- 
term memory pq]. In a similar way, a recently proposed 



dynamical systems theory for evolution proposes a fixa- 
tion of a phenotypic change (by bifurcation) to a slower 
genetic change jl6|. The present mechanism for the prop- 
agation of a bifurcation from faster to slower elements 
will be relevant for the study of such biological systems 
and it will be interesting to examine whether the pro- 
posed three conditions for the dynamics are satisfied as 
well. In connection with physics, the possibility of chang- 
ing the slower dynamics by controlling a faster element 
through a cascade process will be important for the con- 
trol of turbulence in general. 
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